Exponential Families and MaxEnt Calculations for Entropy Measures of Statistical Physics
نویسنده
چکیده
For a wide range of entropy measures, easy calculation of equilibria is possible using a principle of Game Theoretical Equilibrium related to Jaynes Maximum Entropy Principle. This follows previous work of the author and relates to Naudts [1], [2], and, partly, Abe and Bagci [3].
منابع مشابه
Generalised Exponential Families and Associated Entropy Functions
A generalised notion of exponential families is introduced. It is based on the variational principle, borrowed from statistical physics. It is shown that inequivalent generalised entropy functions lead to distinct generalised exponential families. The well-known result that the inequality of Cramér and Rao becomes an equality in the case of an exponential family can be generalised. However, thi...
متن کاملPrinciples of maximum entropy andmaximum caliber in statistical physics
The variational principles called maximum entropy (MaxEnt) and maximum caliber (MaxCal) are reviewed. MaxEnt originated in the statistical physics of Boltzmann and Gibbs, as a theoretical tool for predicting the equilibrium states of thermal systems. Later, entropy maximization was also applied to matters of information, signal transmission, and image reconstruction. Recently, since the work of...
متن کاملMaximum Entropy Production as an Inference Algorithm that Translates Physical Assumptions into Macroscopic Predictions: Don't Shoot the Messenger
Is Maximum Entropy Production (MEP) a physical principle? In this paper I tentatively suggest it is not, on the basis that MEP is equivalent to Jaynes’ Maximum Entropy (MaxEnt) inference algorithm that passively translates physical assumptions into macroscopic predictions, as applied to non-equilibrium systems. MaxEnt itself has no physical content; disagreement between MaxEnt predictions and e...
متن کاملMaximum Entropy Approximation of Small Sample Distributions
In this paper, we propose a simple approach for approximating small sample distributions based on the method of Maximum Entropy (maxent) density. Unlike previous studies that use the maxent method as a curve-fitting tool, we focus on the “small sample asymptotics” of the approximation. We show that this method obtains the same asymptotic order of accuracy as that of the classical Edgeworth expa...
متن کاملEstimators, Escort Probabilities, and Φ-exponential Families in Statistical Physics
The lower bound of Cramér and Rao is generalized to pairs of families of probability distributions, one of which is escort to the other. This bound is optimal for certain families, called φ-exponential in the paper. Their dual structure is explored. They satisfy a variational principle with respect to an appropriately chosen entropy functional, which is the dual of a free energy functional.
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2007